Clean Copy of Substitute Specification 
APPARATUS AM) METHOD FOR SENDIHG DATA OYER A COMMUNICATIONS 
METWORK 
TECHNICAL FIELD 

[0001] The invention relates to communications networks in which a 
local area network (LAN) is connected to a wide area network (WAN) , 
via a plurality of communications links. 

BACKGROUND INFORMATION 
[0002] For domestic users it is conventional to access the Internet 
and the World Wide Web using dial-up connections over telephony links. 
There is an increase in the use of broadband connections, which are 
either provided over cable TV networks or by DSL over the PSTN. 
However, there are some communities for which it is not possible to 
provide with broadband connections, either because they are too far 
from a CATV network or a PSTN exchange or because there are 
insufficient numbers to make a broadband installation economic for the 
network operator, 

[0003] According to a first aspect of the present invention there 
is provided a method of sending data over a communications network, 
the method comprising the steps of an originating terminal generating 
a request for a content server; the originating terminal dividing the 
request into a plurality of packets; the originating terminal 
distributing the plurality of packets to a first plurality of 
terminals over a first network; the first plurality of terminals 
transmitting packets received during step to a reconst itut ion server 
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located in a second network, the first plurality of terminals being 
connected to the second network by a second plurality of connections; 
the reconstitution server receiving the plurality of packets and 
sending the request to the content, server. Additionally, the content 
server sending a plurality of content data packets to the 
reconstitution server in response to the request received previously; 
the reconstitution server distributing the plurality of content data 
packets to the first plurality of terminals over the second plurality 
of connections; the first plurality of terminals sending the plurality 
of content data packets to the originating terminal; and the 
originating terminal receiving the plurality of content data packets 
to re-create the content data . 

[0004] Preferably the plurality of packets are distributed to the 
first plurality of terminals in a round-robin basis. It is further 
preferred that the round-robin distribution of the plurality of 
packets is weighted and that the round-robin weighting is determined 
in accordance with the bandwidth of the connection between the 
terminal and the second network. 

[0005] According to a second aspect, of the present invention there 
is provided a communications network comprising; a first plurality of 
terminals, the terminals being connected by a first network and. having 
a second plurality of connections to a second network, the second 
network comprising a reconstitution server and a plurality of content 
servers, wherein, in use, an originating terminal generates a request 
for one of the content servers, divides the request into a plurality 
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of packets and distributes the plurality of packets between the first 
plurality of terminals via the first network, the plurality of packets 
are sent to the r econst itut ion server via the second plurality of 
connections, the reconst itut ion server sending the plurality of 
packets to the content server. Furthermore, the content server sends 
content data to the reconstitution server, the reconstitution server 
divides the content data into a plurality of content data packets and 
distributes the plurality of content data packets between the first 
plurality of terminals over the second plurality of connections, the 
first plurality of terminals distributing the plurality of content 
data packets to the originating terminal; the originating terminal 
receiving the plurality of content data packets and re-creating the 
content data, 

[0006] The first plurality of terminals may be greater than the 
second plurality of connections or the first plurality of terminals 
may be less than the second plurality of connections. Each of the 
first plurality of terminals may comprise a list identifying the other 
active terminals. Each active terminal may periodically send a first 
status message to the other terminals to indicate that it is active. 
[0007] Furthermore, an active terminal may send a second status 
message to the other terminals prior to becoming inactive. 
[0008] .According to a third aspect of the present invention there 
is provided a reconstitution server, the server, in use, receiving a 
plurality of packets from a first plurality of terminals, and sending 
the request to a content server identified by a request. Preferably, 
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the server, in use, receives a plurality of content data packets from 
a content server in response to the request and distributes the 
plurality of content data packets between the first plurality of 
terminals. The reconst.itut.ion server may be in communication with the 
first plurality of terminals via a second plurality of connections, 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] A preferred embodiment of the invention will now be 
described by way of illustration only and with respect to the 
accompanying drawings, in which: 

[0010] Figure 1 shows a schematic depiction of a communications 

network according to the present invention; and 

[0011] Figure 2 shows schematic depiction of the implementation of 

Layered Service Providers (LSP) in a communications network according 
to the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0012] Figure 1 shows a schematic depiction of a communications 
network according to the present invention, comprising LAN I0G and WAN 
200. The LAN 100 comprises a plurality of LAN terminals 110a, 110b, 
110c, . . . each of which are connected to one or more other terminals 
110 by LAN connections 115. 

[0013] Furthermore, the LAN comprises one or more WAN connections 
120 that connect a LAN terminal to the WAN 200. The WAN 200 comprises 
one or more network access servers (MAS ; 210a, 210b, reconst.itut.ion 
server 230 and a plurality of content servers 240. LAN terminal 110c 
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has a WAN connection 120 to both NAS 210a and 210b, whilst LAN 
terminal llOe has no WAN connection 120 and only a LAN connection 115. 
[0014] In operation, a LAN terminal 110 may communicate with one of 

the content servers using a plurality of the WAN connections, so as to 
provide increased bandwidth for the communication. 

[0015] Conventionally, the request to access a data resource stored 
on a content server comprises a number of packets and these packets 
are transmitted to the content server using the WAN connection 
associated with the terminal. 

[0016] Using a method according to the present invention, terminal 
11 0a distributes the request packets amongst the other LAN terminals, 
with the LAN terminals transmitting the request packets to the WAN via 
the WAN connections. The request, packets are numbered sequentially and 
are routed, via the NAS 210 to the reconst.itut.ion server 23 0, where 
the request packets are sent to the appropriate content server 240, 
[0017] In response, the content, server delivers the requested data 
resource in the form of a plurality of data resource packets to the 
reconstitution server. The data resource packets are then transmitted 
to the plurality of LAN terminals, via the respective NAS ; using the 
plurality of WAN connections. 

[0018] When the data resource packets are received by the LAN 
terminals the packets are forwarded to the LAN terminal that initially 
requested the data where the data resource packets can be re-assembled 
in the correct order and the data resource accessed by the terminal . 
Thus, the present invention enables a LAN terminal to aggregate the 
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plurality of WAN connections in order to provide a virtual connection 
having an increased bandwidth . 

[0019] It is preferred that the LAN terminals are connected via the 
LAN using the Internet Protocol. Any LAN transport medium may be used, 
including standard Ethernet cables, wireless LAN technology (such as 
802. llb/g or Bluetooth) , IP over electricity lines, etc. It is also 
preferred, that each LAN terminal has an active WAN link in addition to 
a LAN interface (it is possible to have one or more LAN terminals 
which do not have a WAN connection, although this will have the effect 
of reducing the efficiency of the present invention as the ratio of 
LAN terminals to WAN connections will be reduced. Typically the WAN 
link will be a PSTN or ISBN dialup connection, with connectivity to 
the global Internet via any ISP. It should be understood, however, 
that other access technologies such as BSL, cable modems, satellite, 
etc. can also be shared using the method of the present invention. 
Typically the WAN will be the Internet, although it may be a corporate 
or academic WAN. The NAS will typically be operating protocols such as 
SLIP (Shared Line Internet Protocol) and/or PPP (Point to Point 
Protocol) to control the communications over the plurality of WAN 
connections . 

[0020] The LAN terminals typically comprise a standard PC running 
popular client applications such as e-mail, WWW browser, media 
streaming, network games, etc. Additional routing software rs 
installed onto the LAN terminals which ensure that outgoing packets 
are re-directed to active LAN terminals. There are various ways of 
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accomplishing this including placing the network card into promiscuous 
mode, creating a default route ' or a platform specific method, such as 
Layered Service Providers (LSP) for Microsoft Windows. In the example 
discussed below it will be assumed that the LSP method is used. It 
will be understood that the invention may also be implemented on PCs 
using other operating systems, such as Linux and Macintosh OS, or on 
other devices such as set top boxes, game consoles, etc that are 
capable of making network connections. 

[0021] Figure 2 shows a schematic depiction of the implementation 
of LSP, in which LSP (Layered Service Providers) 113 is created as a 
dummy' layer, in between the TCP/IP application 112 and the TCP/IP 
stack 114. If LSP is implemented then outgoing packets are trapped: if 
the packet is destined for a local host, then the packet is allowed to 
pass unmodified to the TCP/IP stack ; whilst if the packet is destined 
for a remote network the packet is sent to one of the LA.N terminals. 
As the packet's destination address has now changed, the original 
intended destination IP address and. per;: need r.o be appended to the 
packet's pay load. It is possible to determine whether a packet is 
routed to a remote or local host using known methods, such as 
examining the LAN card ' s host mask . 

[0022] In order for packets to be routed to LAN terminals 

efficiently it is necessary chat each LAN terminal is aware which of 
the other LAN terminals are active. Each active LAN terminal notifies 
the other LAN terminals and the reconstitution server that they are 
still active by periodically transmitting an"ACTIVE"message . If a LAN 
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terminal is to be shut down, i, e. the terminal is being switched off 
then a" SHUT DOWN "message will be transmitted. 

[0023] In the event that a LAN terminal goes down unexpectedly e. 
g. power is lost, then the other LAN terminals and the reconstitution 
server can infer that a LAN terminal is no longer active by the 
failure to receive"ACTIVE"messages . 

[0024] If a LAN terminal fails to transmit an !! ACIIVE"message for a 

predetermined period of time then it will be removed from the table of 
active LAN terminals, which is used to determine which terminals 
packets may be sent to. If a LAN terminal has shut down unexpectedly 
and other LAN terminals are still sending packets to it then there is 
no way to recover this situation. To the applications generating a 
request packet it will appear as if there was network congestion and 
the packets were dropped. If the application uses a reliable transport 
such as TCP then lost packets will be automatically recovered. 
[0025] The LAN terminals status messages may be sent using unicast 
(typically UDP) messages to each of the other LAN terminals, however 
since LANs are generally a shared media, a more efficient means of 
accomplishing this is by sending multicast or broadcast messages. It 
is preferred for the LAN terminals to send status messages to the 
reconstitution server using UDP or TCP, In a preferred embodiment, a 
LAN terminal can be inferred to be active if it is still sending 
packets for forwarding and thus there is no requirement for LAN 
terminals to send status messages if they are currently sending 
packets . 
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[0026] 



LAN terminal 
IP address 


Port Number 


Missed 
Announces 


Weight 


10,0, 1. 3 


7654 


0 


1 


10.0. 1. 4 


7654 


5 


1 


10.0. 1. 5 


456 7 


2 


3 



Table 1. 



[0027] Table 1 shows a typical LAN terminal router list. .As well as 
listing the IP address of active LAN terminals a port number is also 
advertised. This allows a single LAN terminal to run multiple 
instances of the router software e. g. a single computer could have 8 
phone lines and modems connected to it, 

[0028] LAN terminals allocate one port which other LAN terminals 
send packets to, and may possibly allocate a further port for packets 
being received from the reconst itut ion server. 
[0029] When a LAN terminal sends requests to the other LAN 
terminals, the request may be sent using a simple round-robin 
technique. While this is simple to implement, it may not be 
particularly efficient if the different LAN terminals are have WAN 
connections that have significantly different bandwidth capacities, 
[0030] According to a preferred embodiment of the present invention 
ail LAN terminals have an associated weighting value which signifies 
the capacity of the WAN connection to route packets to the WAN. For 
example a 28.8kbps modem might have a weighting of 1, a 56kbps modem a 
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weighting of 2, a dual I SDK dialup a weighting of 4, 500kbps ADSL a 
weighting of 18, etc, 

[0031] These weightings are used to determine the LAN terminals to 
which packets will be routed. For example, if LAN terminal A has a 
56kbps connection, LAN terminal B has a 28, 8kbps connection and LAN 
terminal C has a 56kbps connection and the reconst itut ion server wants 
to send a 5 packet response, it would balance the responses across the 
3 LAN terminals as follows: A, 3, C, A, C. 

[0032] The LAN terminals may have different weightings for upstream 
and downstream transmissions as many access methods do not have 
symmetrical upstream and downstream bandwidths. 

[0033] Weightings can either be set. manually by a user (or the 
network administrator) or can be worked out automatically by 
monitoring the throughput associated with various upstream and 
downstream data transfers. 

[0034] When a LAN terminal receives a packet from one of the other 

LAN terminals it verifies that the packet is valid, e. g. the 
checksums are correct, and if not the packet is dropped. If the packet 
is valid, the packet header is modified whereby the new source IP 
address and port are that of the LAN terminal's and the new 
destination address is that of the reconst it ut ion server, 
[0035] On LAN terminal start-up, the terminal contacts a 
reconst itut ion server in order to log onto the server (some form of 
terminal identification and authentication may be required) . The 
reconstitution server will inform the LAN terminal which port it 
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should communicate on and information is stored as an additional field 
in the active LAN terminal list held on the reconst itut ion server . The 
LAN terminal will use this port to communicate with the reconst itut ion 
server until the reconst itut ion server advises of an update. 
[0036] As well as modifying the packet header, the LAN' terminal 
needs to append the IP address of the originating LAN terminal to the 
packet, adding 4 additional bytes to the payload. This is in addition 
to the 6 payload bytes already added recording the content server IP 
address and port when the LSP layer forwarded, the packet. The port 
number of the originating LAN terminal does not need to be 
encapsulated in the payload as the outgoing port of this packet will 
be set to have the same value. 

[0037] When the reconst itut ion server receives an IP packet from a 
LAN terminal, it checks that the sender is authorised to use the 
service. It then creates a dedicated output port that is associated 
with the IP address and port of the originating LAN terminal. It then 
knows that any responses received on that dedicated port are destined 
for the particular IP address and port. 



Dedicated Port 


54725 


Source IP 


10.0. 1.1 


Source Port 


5173 


LAN identifier 


15 


Last used timestamp 


2135325385 


Tab 


Le 2 
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[0038] The reconst.itut.ion server maintains a table of the 

dedicated output pores, and what hosts they map to (see Table 2) . If 
an incoming dedicated port is not used for a pre-determined period, 
for example 5 minutes , then the port is made available again for re- 
use as it is assumed that there is no further traffic coming. When the 
port is used, that last used ' time stamp is updated, where the time stamp 
is stored in 32 bit UTC time format (UTC represents the number of 
milliseconds since 1st January 1970). When a packet is received 
containing an IP address and port number for an originating LAN 
terminal that are not currently represented in the table a new port 
entry is made. 

[0039] The reconstitution server then sends the packet to the IP 
address and port of the content server from the dedicated port 
(specifying its own IP address as the source TP address for the hop), 
after stripping out; the 10 bytes added to the pay load as they are no 
longer needed. When the content server responds it will send its 
response to the dedicated port at the reconstitution server . The 
reconstitution server determines which LAN the packets are destined 
for and performs a weighted round-robin decision to determine which of 
the LAN terminals the packets should be sent to. Before the packets 
are sent the IP address of the content server and the IP address and 
port numbers of the originating L AN terminal are appended to the 
packet payload so that the originating LAN terminal can re-create the 
intended packet header. The content server's port number can be 
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inferred by setting the outgoing port number to the same -thus saving 2 
bytes payload overhead. 

[0040] When the LAN terminal receives a packet, it extracts ana 
removes the originating LAN' terminal IP address and content server IP 
address/port numbers . It then re-creates the header that the 
originating LAN terminal expects to see, by replacing the 
source/destination IP address and ports. The LSP stack on the LAN 
terminal will only modify outgoing packets, not incoming, and so the 
packet is passed to the application layer unmodified, 
[0041] This system uses principles similar to IP firewalls and 
network/port address translation software and as such inherits some of 
its inherent limitations such as outgoing initiated data transfers are 
only allowed, and. externally initiated data transfers are not 
generally allowed without building exception rules into the software. 
This prevents , for example, many peer to peer and locally hosted web 
services from working. 

[0042] An example of packet routing is given in Appendices A-D 
below. A UDP client-server application called AddltUp'is assumed, in 
which the client sends three packets each containing a number. The 
server responds by echoing the negative of the number back to the 
client. When the server receives the third number, it adds all three 
numbers up and sends back a fourth packer containing the summation of 
the three numbers. 

[0043] The LAN terminal IP address is 10. 0. i.l and uses port 8111 
for incoming and outgoing traffic for that application. The content 
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server's IP address is 132,146, 15,101 and uses port 7111 for incoming 
and outgoing traffic for that application. 

[0044] The LAN housing the LAN terminal has identity 15 and has 
been given the port 10015 on the reconstitution server for incoming- 
traffic. The reconstitution server's IP address is 200,101, 55,1 The 
reconstitution server and the originating LAN terminal know that the 
following LAN terminals are currently active on LAN 15: 
[0045] 



IP Address 


Port 


Missed 
Announces 


Wei ght 


10.0. 1. 3 


7654 




1 


10.0, 1. 4 


4 56 7 


2 





[0046] The present invention will work even if the LAN terminals 

use different ISPs to connect to the internet. However, if all LAN 



terminals use the same ISP and the ISP deploys a reconstitution server 
on their network, the amount of overall backbone traffic is reduced as 



there is less traversing of backbone networks. In addition the data 
flow will be more predictable, increasing the quality of some services 



such as media streaming, as packets routed via the networks of a 
number of ISPs may take radically different paths across the Internet, 



and this can be a cause of packet jitter. 



[0047] Extensive research has shown that single user Internet 
connections are typically left unused 90% to 35% of the time as users. 
Therefore it is unlikely that there would be much local contention 
problem. Additional policy enforce isily be adds tc it a 
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single user within the community does not use a disproportionate 
amount of the shared bandwidth. 

[0048] With shared network connectivity it is possible for users to 
utilise their phone line for voice calls etc. whilst still using the 
Internet (via the collective connections) . Normally a user has to 
disconnect from the Internet to use their phone line for calls. The 
same principles can be applied to non-IP networking technologies such 
as AppIeTalk, 

[0049] It is envisaged that the invention is suitable for use in 
communities in which it is not possible, for economic or technological 
reasons, to provide broadband services such as DSL or cable internet 
links. By aggregating a number of PSTN and/ or ISDN links it is 
possible to provide users with a greater bandwidth, that with a 
sufficient number of users may approach or exceed that provided, by 
DSL. The invention may also be used to aggregate broadband connections 
to provide a connection having further increased bandwidth. Groups of 
LAN terminals may be organised into a community that share a number of 
WAN connections. It is possible that a single LAN may comprise more 
than one such community of LAN terminals and that a LAN terminal may 
be a concurrent member of more tnan one community of LAN terminals, 
[0050] The invention may also be implemented within offices and 
campuses, etc. , as telephone lines can be used for data services when 
not being used for voice services. The use of the phone lines may 
replace or complement a dedicated Internet connection. ISDN would, be 
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an application as it has a quick setup/ tear down 



APPENDIX A 



Packet 1 



Acid 1 1 Up Client 
Send ' 44 ' 


Destination: 132. 146, 15.101 port 
7111 Payload: 4 4 


ISP intercepts. Sends lq 
first LAN terminal in active 
1 1st 


Source: 10. 0. 1.1 port 8111 
Destination: 10,0. 1.3 port ^654 
Payload: 44 


LAN terminal forwards to 
Reconstitution server 


Source: 10. 0. 1.3 port 8111 
Destination: 200.101. 55.1 Port 
10015 

Payload: 4 4 

(132.146. 15.101, 7111,10. 0.1. 1) 


Reconstitution server 
allocates dedicated port, 
for source 10.0. 1. 1/ 
8111 


Source: 200.101. 55.1 port 20001 

port 7111 
Payload: 4 4 


Add I tUp server echoes back 
the negative number. 


Source: 132.146. 15.101 port 
7111 

Destination: 200.101. 55.1 port 
20001 

Payload: -44 


The reconstitution server 
looks up the dedicated port 
entry and sends the packet 
to the next round-robin LAN 
terminal on LAN 15 
(which happens to be 
10.0, 1.4) 


Source: 200,101, 55,1 port 8.111 
Destination : 10.0. 1.4 port 456 7 
Payload: -44 


The LAN terminal receives 
the packet, reconstructs the 
header and forwards to the 
ori g hnal ing LAI i nal , 


Source: 132.146. 15.101 port 
7111 

Destination : 10.0. i.i port 8111 
Payload: -44 



[0052] 

APPENDIX B 
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AddltUp Client 
Send' 5' 


Source: 10.0. 1.1 port 8111 
Destination : 132. 14G. 15. 101 
port 7.1 1 I 
Pay load: 5 


LSP intercepts. Sends to 
second LAN terminal in 
active list. 


Source : 10.0. 1 . 1 port 8 1 1 1 
Destination: 10.0. 1.4 port 4567 
Pay. load: 5 

(132.146. 15 101 ,7111) 


LAN' terminal forwards to 
Reconstitution server 


Source : 10. 0 . 1.4 port a 1 1 1 
Destination: 200. 101. 55.1 per:; 
10015 

Pay load: 5 

(132.146. 15.101, 7111,1 0 , 0 . 1 . 1 ) 


Reconstitution server has 
already allocated dedicated 
port 20001 for Source 

J L , K "- 1 , , 


Source: 200.101. 55.1 port 20001 
Destination : 132.146. 15.101 
port 7111 

i avload : ; 


Add it Up server ecnoes back 
the negative number 


source : 132.146. 15.101 port 
7111 

Destination: 200.101. 55.1 port 
2 0 0 0 1 

Pay load :-5 


The reconst.lt.ut ion server 
looks up the dedicated port 
entry and sends the packet 
to the next round-robin LAN 
terminal on LAN 15 (happens 
to be 10.0. 1.3) 


Source: 200.101. 55.1 port 8111 
Destination: 10.0. 1.3 port /654 
Pay load : -5 

(132. 146. 15.101, 7111,10. 0.1. 
1) 


The LAN terminal receives 
the packet, reconstructs the 
header and forwards to the 
originating LAN terminal, 


Source: 132.146. 15.101 pore 

Destination: 10.0. 1.1 port 8111 
Payloaa:-5 
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[0053] 

APPENDIX C 



Packet 3 



Add I tUp Client. 
Send 18' 


Destination : 132.146. 15.10.1 port 
7111 

Pay load: 13 


LSP to 
next LAN terminal in 


Source : 10.0. 1.1 per t 8 1 1 1 
Destination : 10.0. 1.3 port '654 
Payload: 18 (132.146. 15.101, 

I 111 ' ..„ 


LAN terminal forwards to 
reconstitution server 


source: iO.O. .1.3 port bill 
Destination: 200.101. 55.1 oort 
10015 

Pay load: 18 


Reconstitution server has 
alrea d y a 1 1 o c a ted 
dedicated port 20001 for 


Destination: 132.146. 15.101 port 
7111 

Pay load: 18 


^i^-i^i ,,,, 

tne negative number . 


Source: 132. 146. 15.101 port 7111 
Destination: 200.101. 55.1 port 
20001 

* ayload: :^ .„ . 


The reconstitution server 
looks up the dedicated 
port entry and sends The 
packet to the next round- 
robin LAN terminal on LAN 
15 (happens to be 10,0. 1.4) . 


Source: 2 00 . i Or., bo. i port &ilr. 
Destination: 10. 0. 1,4 port 4567 
Pay load:- 18 

(132.146. 15.101, 7111, 10. 0. 
l.i) 


The ' L - 
the packet, reconstructs 
the header and forwards to 
the originating LAN terminal. 


Source: 132. 146. 15.101 port /ill 
Destination: 10.0. 1.1 port 3111 
Payload :-18 


[0054] 

Packet 4 (Summation Packet) 


Add I tUp server adds up the 
3 numbers (to 67) 


Source: 132. 146. 15.101 port 7111 
Destination: 200.101. 55.1 tort 
20001 

Payload: 67 
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The reconst itut ion server 
looks up the dedicated 
port entry and sends the 
packet to the next round - 
robin LAN terminal on LAN 
15 (happens to be 10,0, 1.3 


Source : 200.101. 55.1 port 8111 
Destination: 10.0. 1.3 port 7654 
Pay load: 6 7 

(132.146. 15.101, 7111,10. 0.1. 1) 


In-^ LAI l o.ves 
the packet, reconstructs 
the header and forwards to 
the . ' i -d 


Source: 132.146. 15.101 port 7111 
Destination: 10.0. 1.1 port 3111 
Payload: 67 
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